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A structured decomposition theorem for Turing machines is given. The 
nature of the building blocks and the form of the connections allowed suggest 
a parallel to the Bohm—Jacopini theorem on structured flowcharts. Thus in a 
broadest sense, there is obtained an independent machine-theoretic restatement 
of the fundamental precepts of structured programming. At the same time, the 
characteristics of the decomposition offer several obvious advantages over 
known results of this type. In particular, the building blocks (the “simple” 
machines) are seen to perform total and regular word functions. Furthermore, 
the connections themselves should prove to be useful as pedagogical tools in the 
Turing machine theory and as a theoretical framework for top-down machine (or 
algorithmic) design. 


1. INTRODUCTION 


In virtually every branch of mathematics or computer science, a “structure 
theorem” can be found at the heart of the theory. One might think of the 
fundamental theorem on Abelian groups (Dean, 1966) or the Krohn—Rhodes 
decomposition theorem (Nelson, 1968) as being typical in the areas of classical 
group theory and the theory of finite state automata, respectively. In this paper 
we seek such a result, a structural decomposition theorem for Turing machines. 

A parallel goal is that of obtaining a machine-theoretic analogy to the well- 
known theorem of Bohm and Jacopini (1966) on structured flowcharts. Since 
the announcement of this result, no single idea in computer science has attracted 
more attention than that of “structured programming” (Dahl, Dijkstra, and 
Hoare, 1972). In essence, the Bohm—Jacopini theorem shows that every flow- 
chart admits an equivalent reformulation in terms of the basic structured 
constructs of Fig. | (and also for convenience, if -+ then +, and do + until ---), 
together with the “simple’’ assignment statements. This result is now so often 
cited and reinterpreted that further clarification or elaboration is not necessary 
here. Besides its theoretical importance, the resulting structured approach to 
programming has lead to a highly successful algorithmic design procedure, 
known variously as “top-down’’ or “step-wise” successive refinement (Wirth, 
1973) of the problem. In addition, the structure of the resulting program or 
flowchart allows one to consider proving the correctness of the algorithm 
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begin S, ;...; Sn end if P then S, else S, while P do S 


FIGURE 1 


(Manna, 1974), a virtual impossibility in the case of an arbitrary unstructured 
flowchart of moderate size. 

Here we present an independent derivation of an entirely analogous system 
of machine constructs whereby one may realize each Turing-computable 
function by a structured connection of ‘“‘simple’’ machines. It then follows that 
to a large extent, we are able to extend the attributes of structured programming 
(including clarity, efficiency, simplicity, etc.) to the realm of structured machine 
design. In a broader sense, one could view our result as a rephrasing of the 
fundamental precepts of structured programming, identifying programs, and 
Turing machines in an appropriate manner. 


2. SIMPLE MACHINES Vs ELEMENTARY MACHINES 


In the widest interpretation, the idea of combining simpler Turing machines 
into ever more complicated ones is not entirely new. Hermes (1965) introduces 
certain connections built up from the elementary machines l, y, r, which halt 
after moving left one square, printing a symbol y, or moving right one square, 
respectively. These are to be compared with the “simple” machines, the building 
blocks of our structural decomposition theorem. 

We recall (Prather, 1975) that a Turing machine Z = (S, £, M) consists of 


(i) a finite set S of “states” (with 0, 1 € S) 
(ii) an alphabet X (augmented as Zp = 2'U {0} 
(iii) a function M (the table of “moves’’) 


M:(S — {1}) x Zo > S x XQ x {L, N, R}. 


As used here, a Turing machine Z ordinarily begins its computation in the 
initial state 0 at the left-hand end of a tape on which the words x; e 2’* (the 


STRUCTURED TURING MACHINES 161 


free monoid on the alphabet X, identity = e) are printed with the blank (C) 
as a word separator. Then Z follows the moves dictated by M unless or until 
the final state 1 is reached. With L, N, R interpreted as left motion, no motion, 
or right motion of the read—write head on an expandable tape and with a standard 
convention for adjoining blanks in the case of a “run-off,” the table M induces 
a relation (—>) on the set 2, * x S x Xpn* whose elements are the instantaneous 
descriptions (id’s) of Z. As indicated above 


0, = (e, 0, x) with x = x, | | ®y ] Sele EA 


is an n-initial i.d. whereas any i.d. 


ly z (0°, 1, yO) with yY =y | Ya Jee | Ym 


is said to be an m-final i.d. More generally, any i.d. with state 1 is called a 
terminal i.d., one for which the machine halts. 
Realizing that 


M(q, 0) = (q', 0’, p) 


means that Z in the state g scanning the symbol o overprints the symbol o’ 
and moves according to » while making a transition to state g’, one can easily 
anticipate the conclusion of Hermes’ theory: Every Turing machine can be 
realized by an appropriate “combination” of elementary machines. One imme- 
diately visualizes that these combinations or connections involve state transitions 
of the sort found in the state diagram representation of finite-state automata. 
But this accounts for one of the main disadvantages of the Hermes scheme for 
machine combinations: As in the case of general flowcharts, the connections 
are wildly unstructured! 

A second drawback concerns the nature of the building blocks themselves, 
the so-called “elementary machines.” No attempt is made to sensure that they 
compute functions f: (2*)” — (2*)™. In fact, for the choice J, y, r this is not the 
case, at least according to any of the established conventions in this regard. 
But suppose we use the terminology of Davis (1958) in saying that the Turing 
machine Z is (n, m)-regular (we write Z = Z™™) if each n-initial i.d. encounters 
a terminal i.d. only if it is m-final. This then allows us to adopt the convention 
that Z = Z"-™ computes the (partial) function 


Wy: (29 > (D*)m 


as given by 


FPA gooey Na) = CPt sees Vn) iff 0, — = — 1 


y? 


with « = x Q x O +e O &n and y = y Oy: O ym as before. Then 
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it is seen, by way of comparison with the elementary machines of Hermes, that 
the simple machines of Section 3 are regular and fofal (in that the functions 
they compute are total functions). 


3. STRUCTURED MACHINES 


The equivalence between the Turing computable and the partial recursive 
functions f:(2*)" —> (2*)" is well known. Most recently (Prather, 1975; 
Eilenberg and Elgot, 1970; Brainerd and Landweber, 1974) there has been an 
increasing trend toward choosing that particular “cryptomorphic’’ version of 
recursive function theory which best suits the discussion at hand. Certainly 
that best describes the approach taken here. We define the class of partial 
recursive functions (over the alphabet 2) to be the smallest collection A = Py 
of partial functions f: (2*)” —> (2*)™ (with n, m > 1) containing the 


(i) binary projection b: (X*)? — 2* 
B(x, y) = y; 
(ii) counting (or “successor” ) function c; Z* —> 3* 
(y= if y=e 
= KO if y =x (0<i<n) 
= ce(x)o if y = xop; 
(iti) diagonal function d: X* —> (&*)? 
d(x) = (x, x); 
(iv) exchange function e: (2*)? > (2*)? 
ex, y) = (V, x); 
and closed under the operations of 
(i) composition, (f o g(x) = g( f (%)), 
Gi) cylindrification, (i X fy, x) = (y, f()), 
y times 
nn res 
(iii’) exponentiation, f*( y, x) = fo f o + o f(x), 
(iv) minimalization, (uf )(x) = inf{ y: f(x, y) = e}, 


for x e(Z*)", y e Z*. When we say “y times” in (iii), we refer to the natural 
ordering of the words of X* as established by the counting function of (ii). Thus 
we identify e with 0, o, with 1, etc. Similarly in (iv’), the infimum refers to this 
same ordering of 2*. 
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FIGURE 2 


It is easily shown (Prather, 1975; Brainerd and Landweber, 1974) that these 
axioms are equivalent to the more usual ones in which primitive recursion plays 
a prominent role. Jn particular 


dob = i: X* > L* 


computes the identity function i(x) = x and with cylindrification, identity func- 
tions of n arguments can be performed. We can perform arbitrary permutations 
of n arguments through composition of exchanges, and arbitrary projections 
from n arguments are also easy to realize. Recursion itself is simulated by an 
appropriate use of exponentiation. 

We take as our catalog of simple machines the group of tables shown in Fig. 2, 
noting that by design 


Ye=b Yoe=c Pod Yp=e, 


as is easily checked. For reasons that become apparent only later, we include in 
our catalog a “right inverse” for C, i.e., a Turing machine C which counts down, 
so that 


Pa = é with cof =i. 
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(1) serial connection (Z; = Z7*+ with s; = fag for 1 <i <n) 


a 2a a i Z, end 


(2) parallel connection (Z; == Zj?*) 


Z = all Z, ; Z,;...; Zn together 
=Z, xX Z, X> X Za 


Z = while A do X Z = do X until 4 


FIGURE 3 


The reader can easily provide a tabular description of such a machine, allowing 


that ĉ(e) = e. In this way, all of our simple machines are total and regular. 


In order to introduce the concept of structured machines, we begin with the 
postulate that each simple machine is structured. Then we agree that if the Z,’s 
(respectively, X’s) are structured, so are the machines Z formed according to 
any of the basic connections appearing in Fig. 3. These are intended to behave 


as follows: 


(1) serial connection, Z = Z"! 5n, 


P(x) = (Fz 0 Fz, 0 7 0 Pz Ax); 


STRUCTURED TURING MACHINES 165 
(2) parallel connection, Z = Z**-*%, . 
P(r, ey 2") = (Pa, Fe) FeO") 
(3) alternative connection, Z = Z"*, 


P(x) = Wz(x) if A halts in state T 


= Wz(x) if A halts in state F; 


(4) iterative connections, Z = Z™”, 


P(x) = Py*(x) if A halts in state F after the Ath cycle 
= undefined if A always halts in state T, 
P(x) = Pyta) if A halts in state T during the kth cycle 


= undefined if A always halts in state F, 


respectively. Note that in (1), (2), the case n = 2 would be sufficient; but then 
our subsequent compositions would be more difficult to describe. 

So far, we have only provided diagrammatic and behavioral descriptions 
of these various connections. Before entering into greater detail, we point out 
that the automata Æ are themselves Turing machines, but only elementary 
recognizers. They do not print, and they always halt at the left in distinguished 
states T or F, one or the other. For our purposes, they need only have the 
capability of finite-state automata. In fact, in the sequel, Æ simply denotes an 
automaton which recognizes whether or not its tape begins with a nonblank, 
symbolizing that the first word on the tape is not the null word. The only other 
recognizer to be encountered is denoted —A since it does just the opposite, 
arriving in state T when its tape does begin with a blank. 

The serial-parallel connections have been fully described elsewhere (Prather, 
1975). In the alternative case (3), we connect 


Zı = Zy? = (S1 > 2, M), 
Z = Zz“ = (Sz, X, Mo), 
and the recognizer A = A™" in forming a composite machine 


Z = Zt = (S, XZ, M) 
= if A then Z, else Z, , 


as follows. For the set of states, we take a disjoint union 


S=S,vS,v S, v {1} (0z = 0, and 1z = 1) 
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with the three tables merged into one and extended to include 
M(T, y) = (Oz, »¥ N), 
M(F, y) = (0z, y N) 
Müz) = (yN) 0S7 
M(1z,,7) = (1, y, N). 


Then the aformentioned behavior Y, is easily understood. 
Similarly for the iterative connections, we join X = X™" and A = Am 
in forming the composite machine 
Z = Zn = (S, X, M) 
= while A do X, 
for which 


S = S4 V Sy (Oz = 0, and 1, =F) 
with the extended entries: 
M(T, y) = (0x, -¥, N) 
M(lx, y) = (O41, y, N) 


The other iterative connection is defined analogously, and in either case, the 
given behavior Wz is once again quite evident. 


(y € Žp). 


4. EXAMPLES OF STRUCTURED MACHINES 


The “identity machine” I = D o B is structured, as is each of the parallel 
connections 
n times 


ti 
M=IxKIxX: xi, (n > 1). 


Whenever there is little possibility for confusion, we also denote these more 
general identity machines by J. As a simple illustration, suppose we define 
a sequence of (n, n)-regular (structured) machines C% by writing 


cC =C, 
CH) — F x CM, 
Then it is clear from the context that J = Do B. On the other hand, if we were 


then to write C™ =I x C for n > 1, we have in mind a generalized identity 
machine. 
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We have ample opportunity to examine the use of more elaborate connections 
in the next section. So it is perhaps advisable that we limit our attention here 
to just those auxiliary machines as are found to be convenient in our exposition 
of the structure theorem. Toward this end, we proceed as above in defining 


BY = B, 

B% — (B x I)o BY; 
DY = D, 

D&D = (D x D®) o (EW x J); 
EY =E, 


ED = (EM) x I)o (I x E). 


If at the same time, we assert that B™ is (n + 1, 1)-regular, D® is (n, 2n)- 
regular, and E™ is (n + 1, n + 1)-regular, then once again the proper inter- 
pretation of the identity machines is clear from the context. We may then 
summarize the main properties of these machines with 


Lemma. For all n >1 the machines B®, CM, D™, E™ are structured. 
Furthermore, 


Ppin(xy >, Xo sey Kata) = Xayr» 
Wot (y pees Xni» Xn) = (Hy see Xni > C(%n)), 
W yin (a0y , Xa sees Xa) = (Hy, Xa peses Xn s Wy s Xa reces Kn) 


Path% , Xo sees Xanga) = (Xa seess Kags X1). 


Proof. A straightforward verification by induction can be given in each case. 


5. A STRUCTURED DECOMPOSITION THEOREM 


Given the description of a Turing machine Z = (S, X, M) as a table of moves, 
it may be quite difficult to ascertain and then to verify just what it is that the 
machine does. The situation is quite analogous to the one we face when asked 
to analyze an arbitrary flowchart. Rather than to rely entirely on the designers 
(programmers) insight and ingenuity, one’s understanding is greatly enhanced 
if the machine (program) can be thought of as a structured composition of sub- 
machines (subroutines) whose behavior is unquestionably clear. Our structure 


theorem for Turing machines shows that this position has universal applicability, 
at least in principle. 


THEOREM. Every partial recursive function (necessarily realized by some 
Turing machine) is realized by a structured machine, i.e., a structured connection 
of simple machines. 
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Proof. The functions b, c, d, e are realized by the simple machines B, C, D, E 
as already remarked. If f, g are realized by structured X, Y, respectively, then 
it is clear that Z = X oY has the desired behavior for realizing the composition 


Pla) = Pyor(%) = (Px ° Pya) = (f ° 8)(2)- 


Cylindrification is also easily accomplished, for if Z = I x X then we have 
P29, 2) = Prl ys 2) = (PI), Px) = (9, f) 


as required. 

The structured implementation of exponentiation is somewhat more difficult. 
If f: (2*)" — (2*) and Yy = f for the structured machine X = X”-”, then we 
set 

Y=ĈxX 
Z = (while A do Y)o(B x J). 


It follows that Z is structured and 


P(Y, x) = Ponit aaor ° Foxy, %) 
y times 
= Paaule, Px ° Myo + o Wx(x)) 
y times 
= Wyo Pyo vo Py(a) 


y times 
= fofo o f(x) = f*(y, 2). 


Finally, if f: (2*)"+4 —> 2* and we have a structured machine X = X14 
with Wy = f we define the machines 


T = Tem? = (D x I)o (while A do C) x I) o (D x Io EM 
U = Urn — Dm o(X x I) 

V = Vr. — Birt) 

W = Wont — Clint), (B x I) 


together with 
Z = begin T; 
do begin 
if A then W else B x I; U 
end 
until —A; 
y 
end. 
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According to the lemma T, U, V, W are structured and 


ME iti voces Xn) = (6, Xy yikes Xn y €) 
Pult yeo Xn) = (Ply sees Anrh Xise Xnia) 
Py, Hy gerry Xn a Xni) = Kny 


Ppl y, X ses Xn s ngi) = (21 5 Hn» CX pra), 


It follows that Z is structured, and furthermore 


Po (aty yeeey Xn) = Pro Pao-mtiima ° Pyh yeo Xa) 
= Paomtiimna ° Pye X1 zes Bn > €) 
= Pyle, Xi sees Xn, inff y: Py(ay ,..., Xna Y) = €}) 
= inff y: f(x so Xn Y) =e} 
= (pf m1 y+) Xn), 


thus implementing minimalization. 


CoroLLary. Corresponding to each Turing machine Z is a structured connection 


of simple machines which computes the same (partial) function. The correspondence 
Z — Z is effective. 


Proof. The main assertion follows from the theorem and the classical 
equivalence between Turing machines and partial recursive functions. The 
effectiveness of the correspondence f —> Z° is already illustrated in the proof of 
the theorem. But we note that certain well-known constructions (Davis, 1958; 
Yasuhara, 1971) show that the association Z — f of partial recursive functions 
with arbitrary Turing machines is also effective. 


6. CoNCLUDING REMARKS 


It can be argued a full-fledged canonical decomposition theorem would require 
that the “simple” machines exhibit some characteristic property not shared by 
all Turing machines. Thus in the fundamental theorem on Abelian groups, the 
building blocks are cyclic groups, and in the Krohn—Rhodes decomposition 
theorem, the “simple” machines are either two-state machines or machines whose 
semigroup is a simple group. So is this respect, our theorem is somewhat less 
than completely satisfactory. Nonetheless, we feel that the constructs involved 
and the connections themselves should prove to be useful as pedagogical tools 
in the Turing machine theory and as a framework for orderly algorithmic design. 

In a broadest sense, our decomposition theorem might be viewed as a restate- 
ment of the fundamental ideas of structured programming. But surely this 
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theorem is not unique of its type. Other choices of “simple’’ machines are quite 
possible and other connection constructs could also be conceived. Quite 
obviously, we were looking for those connections which would most closely 
parallel the familiar structured programming constructs. As for the resulting 
class of simple machines chosen, we can at least argue that for the most part, 
they too are parallel to the use of the simple assignement statements of the 
structured programming theory. Thus C bears a strong resemblance to the 
assignment statement y <-y + 1 whereas E is aking to the familiar three- 
assignment exchange: temp <— x, x <— y, y <- temp. An interesting question, 
however, in the context of the given set of connections and machines B, C, D, E 
is whether the machine C is actually necessary or whether it is a structured 
connection of B, C, D, E? 

Returning once more to the analogy with structured programming and parti- 
cularly the Bohm—Jacopini result, we note that a detailed proof of our corollary 
would point the way toward an effective procedure for transforming any given 
Turing machine into an equivalent structured machine. But surely this technique 
would be no more useful than is the Bohm-Jacopini construction for trans- 
forming an aribtrary flowchart into a structured flowchart, and in fact, such an 
approach would miss the point completely. For it seems that the value of either 
system of structured constructs lies in their applicability toward a “top-down’’ 
algorithmic design methodology. In the cas of Turing machines, it is not impor- 
tant that this approach be carried all the way down to the level of the “simple” 
machines, however these are defined. It is the design method itself which offers 
the advantages of clarity, simplicity, and in the right hands, even elegance and 
an assurance that the machine will indeed perform as intended. 


RECEIVED: June 11, 1976; revisep: November 23, 1976 
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